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Abstract 

Time domain stability robustness analysis and design for linear multi- 
variable uncertain systems with bounded uncertainties is the central theme of 
the research under the present grant. After reviewing the recently developed 
upperbounds on the linear, elemental (structured), time varying perturbation 
of an asymptotically stable linear time invariant regulator, it is shewn that 
it is possible to further improve these bounds by employing state transforma- 
tions. Then introducing a quantitative measure called the 'stability 
robustness index', a state feedback control design algorithm is presented for 
a general linear regulator problem and then specialized to the case of 'modal 
systems' as well as 'matched systems'. The extension of the algorithm to 
stochastic systems with Kalman filter as the state estimator is presented. 
Finally an algorithm for 'robust dynamic compensator' design is presented 
using Parameter Optimization (PO) procedure. Applications in aircraft control 
and flexible structure control are presented along with a comparison with 
other existing metneds. 
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I. INTRODUCTION AND PERSPECTIVE 

) 

It is well known that the inevitable presence of modeling errors' in the 
model used for control design invariably limits the performance attainable 
from the control system designs produced by either classical (frequency domain) 
or modern (time domain) control theory. It is irhus evident that ’robustness 1 
is an extremely desirable (for some applications, even necessary) feature of 
any feedback control design proposed. ’Robustness’ studies of linear systems 
is the central theme of the present research. 

For our present purposes a ’robust 1 control design is that design which 
behaves in an ’acceptable’ fashion (i.e., satisfactorily meets the system 
specifications) even in the presence of modeling errors. Since the system 
specifications could be in terms of stability and/or performance (regulation, 
time response, etc.) we can conceive two types of robustness, namely, 

’Stability Robustness’ and ’Performance Robustness’. Limiting our attention in 
this research to ’parameter errors’ as the type of modeling error that may 
cause instability (or performance degradation) in the system, we formally 
define ’stability robustness’ and ’performance robustness 1 as follows: 
’Stability Robustness 1 . Maintaining closed loop system stability in the 
presence of modeling errors, mainly parameter varitions. 

’Performance Robustness 1 : Maintaining satisfactory level of performance (or 

regulation) in the presence of modeling errors, mainly parameter variations. 

Clearly ’stability robustness’ is a prerequisite to ’performance 
robustness’. Hence in this research we concentrate on the aspect of ’stability 
robustness’ while the aspect of ’performance robustness’ is addressed in the 
research sponsored by the Wright Patterson Air Force Base under a separate 
contract and these details are discussed in ref. [1]. 
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The published literature on the 'robustness' of liner systems can be 
viewed mainly from two perspectives, namely i) frequency domain analysis and 
ii) time domain analysis. The main direction of research in frequency domain 
has been to extend and generalize the well known classical single input single 
output treatment to the case of multiple input multiple output systems, using 
the singular value aecompos ition [2-3]. In the case of frequency domain 
results, the perturbations are mainly viewed in terms of 'gain' and 'phase' 
changes [4-5]. The time domain treatment is more or less similar to the 
frequency domain treatment in spirit but quite different in detail. The time 
domain treatment is more amenable to treating perturbations in the form of real 
parameter variations, nonlinearities and external disturbances and also for the 
physical interpretation of many real life perturbations. This research treats 
the robustness analysis and design from time domain viewpoint and in particular 
focuses on the well known Linear Quadratic Regulator problem. In addition, the 
main tool used is the Lyapunov stability analysis which allows time varying 
perturbations to be considered in the analysis. 

The problem of maintaining the stability of a nominally stable system 
subject to perturbations has been an active topic of research for quite some 
time. One factor which clearly influences this type of analysis is the 
characterization or type of 'perturbation'. Even in the context of nominally 
stable linear systems, the 'perturbations' can take different forms like 
linear, nonlinear, time invariant, time varying, structured and unstructured. 
"Structured perturbations' are those for which bounds on the individual elements 
of the perturbation matrix are known (or derived) whereas 'unstructured 
perturbations' are those for which only a norm bound on the perturbation matrix 
is known (or derived). In this reserch, we focus our attention on linear, time 
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varying, structured perturbations as affecting a nominally stable linear time 
invariant system. 

With this perspective in mind, the report is organized as follows: 

Section II briefly reviews the recently developed upper bounds in the linear, 
time varying, structured (elemental) perturbation of an asymptotically stable 
linear time invariant system to maintain stability. Then a state transformation 
technique is presented to further reduce the conservatism of these bounds. 
Section III is completely devoted to the design of linear full state feedback 
controllers for robust stability where the algorithms are specialized to 'modal 
systems' (as in flexible structure examples) and 'matched systems' (where the 
uncertainty satisfies a special condition called 'matching condition'). The 
design algorithm is also extended to stochastic systems with state estimate 
feedback. Section IV addresses the important aspect of designing reduced order 
dynamic compensators (which have practical implications) with robust stability 
as an additional constraint to the standard linear quadratic regulator problem. 
The solution technique involves parameter optimization (PO) concept. The 
proposed procedures are i llustrated with several examples. Finally Section V 
offers some concluding remarks and explores avenues for future research that 
needs the continued sponsorship of NASA. 
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II. ANALYSIS OF STABILITY ROBUSTNESS FOR LINEAR SYSTEMS 
In the present day applications of linear systems theory and practice, one 
of the challenges the designer is faced with is, to be able to guarantee 
'acceptable 1 behavior of the system even in the presence of perturbations. The 
fundamental 'acceptable' behavior of any control design for linear systems is 
'stability' and accordingly one of the important tasks of the designer is to 
assure stability of the system subject to perturbations. 

In particular, as discussed in the introduction, we concentrate on 
'parameter uncertainty' as the type of perturbation acting on the system. This 
section, thus, addresses the analysis of 'stability robustness' of linear 
systems subject to parameter uncertainty. 

2.1 Review of Stability Robustness Bounds in Time Domain 

We now briefly review the upper bounds for robust stability available in 
the literature for the two kinds of perturbation discussed in Section I. 
Consider the following linear dynamical system 

x(t) = A(t ) x (t) = [A 0 + E(t) ] x (t) (2.1) 

where x(t) -*■ R n is the state vector, A 0 is the nxn nominally stable matrix and 
E(t) is the 'Error' matrix. 

2.1.1 Bounds for Unstructured Perturbation (U.P.) 

Explicit bounds for robust stability under unstructured perturbations have 

been reported in refs. [6-8]. In these refs., it is shown that the system of 

(2.1) is stable if 

_ , t _ CT min(Q) _ 

CTmax^ (t ) 1 < = p (2.2a) 

CT max(P) 

where F satisfies the Lyapunov equation 
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PA 0 + Aq P + 2Q = 0 (2.2b) 

It was shown by Patel and Toda in [8] that Q = I n maximizes the ratio H 
for given A 0 . Thus the eventual bound is given by 

1 

°max(E(t) ) < 7*7 = u p (2,3a) 

^maxv p l 

where P satisfies the Lyapunov equation 

P A 0 + A 0 T P + 2I n = 0 (2.3b) 

2.1.2 Bounds for Structured Pert ur bations (S.P.) 

In [8], using the bound for unstructured perturbations, a bound for 

structured perturbation was presented as 

u p a j/' A Max 

e < -- where E-jj(t) < c-j i - !-ii(t)|niax z - _ . e-jj (2.4) 
n i,J 

and Wp is as defined by (2.3). 

Recently, by taking advantage of ths structural information of the nominal 
as well as perturbation matrices, improved measures of stability robustness are 
presented in [9] -[10] as follows: 


The system of (2,1) is asymptotically stable if 

e,J < TZ&S& ■ UeU 3 “ 5 Ue, ' J 3 “ S1J 


or e x i*s 

for all i,j = l,...,n where P satisfies (2.3b) and 


(2.5a) 

(2.5b) 


U e i j = si j/ e (Thus 0 _< U e -j j £ 1) (2.5c) 

It may be noted that U e can be formed even if one knows only the ratio 
e-jj/s instead of knowing e-jj (and e) separately. One suitable choice for the 


ratio is 
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^eij = e ij/ £ = l^oi j ! / l^oi j (max ‘ ( 2 .5d ) 

for all i,j for which e-jj * 0. 

Remark 1 : From (2.4), it is seen that ejj are the maximum modulus 

deviations expected in the individual elements of the nominal matrix A 0 . If we 
denote the matrix a as the matrix formed with e-jj, then clearly a is the 
'majorant' matrix of the actual error matrix E(t). It may be noted that U e is 
simply the matrix formed by normalizing the elements of A (i.e. e-jj) with 
respect to the maximum of e-jj (i.e. e) 

i.e., a = e U e (absolute variation). (2.6) 

Thus e-jj here are the absolute variations in A 0 -j j . Alternatively one can 
express a in terms of percentage variations with respect to the entries of 
A 0 jj. Then one can write 

a = 5 A orn (relative (or percentage) variation) (2.7) 

where A onr jj = |A Cl1 ;j] for all those i,j in which variation is expected and A om -j j 

= 0 for all those i,j in which there is no variation expected and 5jj are the 

maximum relative variations with respect to the nominal value of A 0 jj and 
Max 

« = i,j s-jj. Clearly, one can then get a bound on 5 for robust stability as 

x < where P is the same as in (2.3) and (2.5). 

CT max(PmAom) 

2 . 2 Reduction in Conservatism by State Transformation : 

The proposed stability robustness measures presented in the previous 
section were basically derived using the Lyapunov stability theorem, which is 
known to yield conservative results. One 'improvement' obtained in the 
proposed bounds is the result of exploiting the 'structural' information about 
the perturbation. Clearly, another avenue available to further reduce the 
conservatism is to exploit the flexibility available in the construction of the 
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Lyapunov function used in the analysis. In this section, a method to further 
reduce the conservatism on the element bounds (for structural perturbation) is 
proposed by using state transformation. This reduction in conservatism is 
obtained by exploiting the variance of the 'Lyapunov criterion conservatism' 
with respect to the basis of the vector space in which the function is 
constructed. The proposed transformation technique seems to almost always 
increase the region of guaranteed stability and thus is found to be useful in 
many engineering applications. 

2.2.1 State Transformation- and Its Implications on Bounds 

It may be easily shown that the linear system (2.1) is stable (or 
asymptotically stable) if and only if the system 

A A A 

x(t) = A(t) x(t) (2.8a) 

where 

A A 

x(t) = M- 1 x (t ) , A(t) = M-l A(t)M (2.8b) 

and M is a nonsingular time invariant nxn matrix, is stable (or asymptotically 
stable) . 

The implication of this result is, of course, important in the proposed 
analysis. The concept of using state transformation to improve bounds based on 
a Lyapunov approach has been in use for a long time as given in [11] where Siljak 
applies this to get bounds on the interconnection parameters in a decentralized 
control scheme using vector Lyapunov functions. The proposed scheme in this 
paper is similar to this concept in principle but considerably different in 
detail when applied to a centralized system with parameter variations. In this 
context, in what follows, we transform the given perturbed system to a 
different coordinate frame, derive a stability condition in the new cordinate 
frame. However realizing that in doing so even the perturbation gets 
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transformed, we do make an inverse transformation to eventually give a bound on 
the perturbation in original coordinates and show with the help of examples 
that it is indeed possible to give improved bounds on the original 
perturbation, with state transformation as a vehicle than without a 
transformati on. 

We now investigte the use of a transformation on the bounds for both 
unstructured perturbations (U.P.) as well as for structured perturbations (S.P.). 
2.2.2 Unstructured Perturbations 

Theorem 2.1: The system of (2.1) is guaranteed to be stable if 


||E(t)|| s = %a X CE(t)] < ----- = V (2.9a) 

I I M- 1 1 Is! | M | |s 

1 

where u p (2.9b) 

A 

°max( p ) 

A 

and P satisfies 

A A A A 

P A 0 + A 0 T P + 2I n = 0 (2.9c) 

and * * 

A 0 = M-l A 0 M, E(t ) = M-l E ( t ) M. (2.9d) 


Note that l|E(t)|| s <_||M" 1 |ls | | E ( t ) 1 1 s ||M|| S and u p * = u p /a where a is a 
scalar given as a function of the transformation matrix M. In this case, of 
course, a is the condition number. Also it is to be noted that the stability 
condition in transformed coordinates is 

A A 

°rnax[E(t)] < u p . (2.10) 

A A 

Thus w p is the bound on ||Ej| s whereas w p * is the bound on | | E | | s after transfor- 
mati on. 

By proper selection of the transformation matrix M it is possible to obtain 
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w p* > w p as shown by the following example 

Example 1 : Consider the same example considered in [ 8 ], The nominally 

asymptotically stable matrix A 0 is given by 



Ao = 

-3 

-2 I 1 

| ; with M =. 

0.9S964 

-0.28217 

r~ 


_ 1 

o_| ! 

_ 0.0266 

0.95937_ 


the bounds 

are 

obtained as 




u p = Bound before transformation. 
y p* - Bound after transformation. 

2.2.3 Structured Perturbations 

Similar to the unstructured perturbation case, it is possible to use a 
transformation to get better bounds on the structured perturbation case also. In 
fact, in the case of a structured perturbation, it may be possible to get higher 
bounds even with the use of a diagonal transformation. Hence in what follows, we 
consider a diagonal transformation matrix M for which it is possible to get bound 
in terms of the elements of M. 

Theorem 2.2 : Given 

M = Diag [mj, m 2 , m 3 , ..., m n ] (2.11) 

the system of ( 2 . 1 ) is stable if 


U P 



V 

0.382 

0.394 


1 


or 

where 


e ij < — 
max 

1 » J 



— Ueij 
mi 


£ < V 


1 



°max( p mUe)s 


u ei .j = u s* Ueij 


( 2 . 12 a) 


( 2 . 12 b) 

( 2 . 12 c) 


! 
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A A Ay A 

and PA 0 + A 0 P + 2I n = 0 


• (2.1 2d ) 


and 


. * . . rn j 

u eij = e ij/e and eij = | — | e x j 

m i 


( 2 . 12 e) 


As before u s * = y s/ a where a is again a function of the transformation matrix 
elements m^ . 

Example- 2: As before let 



-3 -2 | 

1 0 


1 0 

II 

o 

< 

1 . Let U e - 


; With M = 



_ 1 o J 

_1 0_ 


_0 2 . 2 _ 


we get 


u S 

u S * 

0.4805 

- 0.6575- 


u s = Bound before transformation. 
u s * - Bound after transformation. 


The use of a transformation to reduce conservatism of the bound for 
structured perturbations and its application to design of a robust controller for 
a VTOL aircraft control problem is presented in [12]. 

Remark 2 : The flow chart for obtaining the bounds by transformation is as 

fol lows: 


Original Coordin- 
tes, x(t) 

l|E|| s < u p (u.P.), 
e < U 5 (S.P.) 

Transfor- 

mation 

M 

Transformed * 
Coordinates, x(t) 

A AAA 

1 1 F 1 1 a < U_ f < V. 

M " 1 

W 

Original Coordinates, 
x(t) 


II 11 II S s p, s 


IIEIIs < V- s < V 


Remark 3 : The evolution of bounds u to Up to Up* (u s to u s to u s *) can be 


summarized as follows: 
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_ °min(Q) 


1 

ii i - 

Oflia x ("P) 


a max(P) 

_ °min(Q) 

u r - . . . 

Q * In 

1 

- 

CT max( Tr i' ! e)s 


cr max(I > mI'e)s 

V = Lyap.funct = x T F x 


< 

II 

X 
— 1 

"O 

X 

■p A 0 + A 0 T F + 20 = 0 
“ 


p A 0 + A 0 T p + 2I n 


= 0 


x(t) = 


V of ( 2 - 9 )> 

V of (2.12) 


A A A 


V = X' P X 

A A A A 

P A 0 + A 0 T P + 2I n = 0 


From the above sequence, it is clear that the coordinate frame in which the 
Lyapunov function is constructed has a significant effect on the bound in 
relation to the effect of the matrix Q in a given coordinate frame. 

2.2.4 Determination o f (almost) -Best 1 Transformation 

As seen from the previous section, in order to get a better (higher) bound, it is 
crucial to select an appropriate transformation matrix M. Obviously the question 
arises: How can one find a transformation that gives a better bound than an original 
one or even the 'best* among all possible choices for the transformation. In this 
section, we attempt to address this question for the special case of a diagonal 
transformation to be used in the structured perturbation case. 

'Best' Pi agonal Transformation- for- S.P. 

Recall from (2.12), the expression for u s *. Without loss of generality, let us look 
for 1 % > 0 (k = 1,2, ...,n) such that u s * is 'maximized'. 

From (2.12), the matrix P satisfies 

A A 

P(M-1a 0 M) + (M-IAqM)T P = -2I n (2.13) 

Since M is diagonal, M T = M and (2.13) gives 

A A 

(M-lPM-l)A 0 + A 0 T (M-1PM"1) = -2(M" 1 ) 2 


(2.14) 
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Letting 

P* = M-lpM'l (i.e. Pi j = p*i j-m-jinj ) (2.15) 

(2.15) becomes 

P*A 0 + A 0 T P* - -2(M-1)2 (2.16) 

The matrix equation (2.16) contains n(n+l)/2 scalar equations from which the 
elements of the matrix P * can be expressed as functions of m^ . And from (2.15), 

P i j can then be expressed as functions of mi. Thus one can express the bound of y s * 
of (2.12) as a function of mi. We need to find mi that maximize ^s* by determining 
the first order derivatives and equating them to zero. However contains the 

a * 

spectral norm of (P m U e )s which is difficult to express in terms of mi. Hence, 
using the fact that | | (• ) | | s <_ 1 1 ( • ) I |p» we choose to maximize 

A 1 

l = (2.17) 

* * 2 mj 

t (PmUe)sij ( — ^eij)]^ 

i > J i.j m i 

with respect to m^ , i = l,2,...,n. 

The algorithm is best illustrated by a simple example. 

Example 3: 


1 

-3 

_9 

l— ; 


1 

0 

A° = 

_1 

0_ 

, U e - 

*_o 

0_ 


For simplicity let us select M = Diag[l, m]. 

Carrying out the steps indicated above, we observe that the minimum value of 
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= p n 2 + 1/2 pi2 2 

1 11 

= (0.333 + 1.667 ( — )2 + - ( — )2 

m 2 2 2m 

occurs at m + »■ and thus L m ax = 3. 

Hence, Lfnax = 3 •+■ Ug* = 3. 

Note that before transformation, u s = 1.657. Thus there is an 81% improvement 
in the bound after transformation. 


Application to-the Drone Example- [5] : 


The system matrices for the Drone Lateral Attitude Control system considered in 


[5] are given by 


-0.0853 

-0 

.0001 

-0.9994 

46.8600 

-2 

.7570 

0.3896 

-0.4248 

-0 

.0622 

-0.0671 

0.0000 

1 

.0000 

0.0523 

0.0000 

0 

.0000 

0.0000 

0.0000 

0 

.0000 

0.0000 

"0. 

o 7 



0. 

0. 



0. 

0. 



0. 

0. 



20. 

0. 



0. 

20. 




With a linear state feedback control gain 


0.0414 

0.0000 

0.1862 

0.0000 

-124.3000 

128.6000 

0.0000 

-8.7920 

-20.4600 

0.0000 

0.0000 

0.0000 

0.0000 

-20.0000 

0.0000 

0.0000 

0.0000 

-20.0000 


(2.18b) 


G = 


-215.1000 

-231.5000 


4.6650 

-3.7230 


7.8950 233.2000 

7.4530 -213.5000 


-6.7080 

2.5540 


2.5540 

-6.8690 


(2.18c) 


the closed loop system matrix X = A + BG is made asymptotically stable 
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Now assuming the element A 21 to be the uncertain parameter (having a nominal value 
= -46.86) we get the stability robustness bound on this parameter (using the U e 
matrix as U e 2 i = 1 and U ei -j = 0 for all other i,j), as 

fi2i = 2.43 (2.19) 

However, using the transformation 

M = Diag [0.005 11111] (2.20) 

we get the bound on A 21 as 
★ 

21 = 573.46 (2.21) 


which is clearly a significant improvement. 



- 16 - 


III. FULL STATE AND STATE ESTIMATE FEEDBACK CONTROL DESIGN FOR ROBUST STABILITY 
The foregoing discussion in Section II is basically concerned with the analysis 
of stability robustness for linear systems. No effort was made to synthesize a 
controller to achieve stability robustness. In this section, we address this design 
aspect from a systematic algorithmic point of view. The philosophy behind the proposed 
procedure is to make use of the perturbation bounds developed in the previous section 
in a design formulation and give an algorithm to synthesize controllers for robust 
stability. Towards this direction, a quantitative measure called 'stability robustness 
index' is introduced and based on this index a design algorithm is presented by 
which one can pick a controller that possesses good stability robustness property. 

The algorithm, for given size of perturbation can be used to select the range of 
control gain for which the system is stability robust or alternatively, for given 
control gain, can be used to determine the range of the size of allowable perturbations 
for stability. In this attempt, we first consider the case of full state and state 
estimate feedback controllers and then investigate the use of reduced order dynamic 
compensators in Section IV. In this section we also specialize the design algorithm 
to 'modal systems' as well as 'matched systems'. 

3 . 1 Linear State Feedback Control Design Using Perturbation Bound Analysis 
Consider the linear, time invariant system described by 
x = Ax + Bu 

( 3 . 1 ) 

y = Cx 

where x is nxl state vector, the control u is mxl and output y (the variables we wish to 
control) is kxl. The matrix triple (A,B,C) is assumed to be completely controllable and 
observable. Let the control law be given by 


u = Gx 


( 3 . 2 ) 
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Absolute variation 


(3.3) 


Now let aA and aB be the perturbation matrices formed by the maximum modulus 
deviations expected in the individual elements of matrices A and B rspectively. 

Then one can write 

aA = e a Ue a 
AB = eb Ue b 

where e a is the maximum of all deviations iri A and eb is the maximum of all deviations 
in B. Then the total perturbation in the linear closed loop system matrix of (3.1) 
with nominal control u = Gx is given by 

A = AA + ABG m = e a Ue a + eb Ueb G m (3.4) 

Assuming the ratio eb/e a = E is known, we can extend the main result of section 
(2.1.2) to the linear state feedback control system of (3.1)-(3.2) and obtain the 
following design observation. 

Design ObservatTon 1 : 

The perturbed linear system is stable for all perturbations bounded by e a an d 

eb if 


e a 


< 


1 


= y 


^maxCPmUea + e Ueb Gm!s 


(3.5a) 


and eb < e y where 

P(A+BG) + (A+BG)T P + 2 I n = 0 


(3.5b) 


Alternately, we can write 
AA = <5 a A m ~] 


Relative variation 


(3.6) 


AB = <$b 3m J 

where Am-jj = |Aij| and Bm-jj = |Rij| for all those i,j in which variation is expected 
and Am-jj = 0, Bmjj = 0 for all those i , j in which there is no variation expected. 

For this situation, assuming Sb/6 a = 6 is known, we get the following bound on 6a for 
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robust stability. 

Design-Observation 2 : 

The perturbed linear system is stable for all relative (or percentage) 
perturbations bounded by 6 a and fib if 


1 


«a < 


= w r 


(3.7) 


^max^PmC^m 4 B m G m )] s 
and fib < fi u r where P satisfies the equation (3.5b). 

Stability Robustness Index- and- Control- Design Algori-thm : 

We now define, as a measure of stability robustness, an index called 'Stability 
Robustness Index as follows: 

Case a) : L.H.S. of (3.5 or 3.7) is known (i.e. checking stability for given 

perturbation range). For this case 

s S.R. = u-ea (or w r-5a)* (3.8a) 

Case b) : L.H.S. of (3.5 or 3.7) is not known (i.e. specifying the bound). For 

this case 

Ss.R. = v (° r u r) • (3.8b) 

It is clear from the expressions for u (3.5), the 'error matrix' (3.4) and 
^S.R. (3.8) that these quantities depend on the control gain G and as the gain G is 
varied Ss.R. changes. In order to plot the relationship between 8 s. R. ap d the gain 
G, we need a scalar quantitative measure of G. For this, we can either use 

Jen = I | G | Is = qnax( G ) (3.9a) 

or 


J cn = Cf (u T u)dt]l/2 = [f xTGTQ Xdt ]l/2 
o o 


(3.9b) 


where J cn denotes a measure of 'nominal control effort'. We use (3.9b). 

The variation of 85 . r. with the control effort J cn is very much dependent on 
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the perturbation matrices and on the behavior of the Lyapunov solution, which cannot 
be described analytically in a straightforward way. Assuming stability robustness 
is the only design objective, the design algorithm basically consists of picking a 
control gain that maximizes stability robustness (Rs.R.)» Specifically the 
algorithm involves determining the index 8s. r. and the control effort J cn for 
different values of the control gain G and plotting these curves. These design 
curves can then be used to pick a gain that achieves a high 8s.R.* The algorithm 
thus provides a simple constant gain state feedback control law that is robust from 
stability point of view. The algorithm, for given perturbations, can be used for 
selecting the range of control effort for which' the system is stability robust or 
alternatively for given control effort, can be used to detemine the range of 
allowable perturbations for stability. 

The linear control gain G of (3.2} can, of course, be determined in many 
different ways. In this section, we assume the control gain G to be given by the 
standard linear quadratic regulator algorithm. Accordingly, we determine G as 

1 1 T 

G = R 0 -l BT K (3.10a) 

pc 


wnere K satisfies the Riccati equation 


KA + ATK - KB 


Rtf 1 _ 
gTk + Q = o 

pc 


(3.10b) 


for a given symmetric positive semi definite matrix 0 and R 0 = I m . Thus p c serves 
as the design variable. 

In other words, in the proposed procedure, we determine the gain by some nominal 
means and then investigate the robustness of the closed loop system by checking if 
the gain makes the index B$.r. positive for a given e a (or et>) (case a situation) 
or by determining Bj.r. - u for given control gain (for case b situation). 
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Extension to Linear Stochastic Systems With State Estimate Feedback : 

We now extend the above analysis to the case of linear stochastic systems. Let 
us consider a continuous, linear, time-invariant system described by 


x(t) 

= Ax(t) + Bu(t) + Dw(t), x(0) = x 0 

(3.11a) 

y(t) 

= Cx(t) 

(3.11b) 

z(t) 

= Mx(t) v(t) 

(3.11c) 


where the state vector x is nxl, the control u is mxl, the external disturbance w is 
qxl, the output y (the variables we wish to control) is kxl, and the measurement 
vector z is £xl. Accordingly the matrix A is of dimension nxn, B is nxm, D is nxq, 

C is kxn and M is £xn. The initial condition x(0) is assumed to be a zero-mean, 
Gaussian random vector with variance X 0 , i.e., 

E[x(0) ] = 0, E[x(0)xT( 0)] = X 0 (3. lid) 

Similarly the process noise w(t) and the measurement noise v(t) are assumed to be 
zero-mean white-noise processes with Gaussian distributions having constant 
covariances, W and V, respectively, i.e., 

E[w(t)] = E[v(t) ] = 0 (3. lie) 


E 

w(t) 

CwT(t)vT( t )] |“W 0 ~ 


_ v (t ) _ 

i L o p e v 0 _ 


<S(t-T) 


(3. Ilf) 


where p e is a scalar greater than zero and V = p e V 0 and s is the di rac delta function 
and E is the expectation operator. 

The state x(t) of the stochastic system is estimated as a function of the 
measurements, where the state estimator has the following structure 

A A A 

x (t ) = Ax(t) + Bu + Gz(t) (3.12a) 

where 


z(t) = z(t) - Mx(t) 


(3.12b) 
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is called the measurement residual. For minimum variance requirement, the estimator 
of Eq. (3.12) is the standard Kalman filter. 


We also assume that the matrix pairs [A,B] and [A,D] are completely controllable, 
and the pairs [A,C] and [A,M] are completely observable. 

For this case of linear stochastic system, we consider the control law given 


by 

A A. 

u = Gx = -- R 0 -l 8 t Kx 
pc 

where 


x = Ax + Bu + G(z-Mx), >.(0) = 0 


= (A + BG - GM)x + Gz 

^ 1 A 
G = — PMT V 0 -l 

Pe 

and P and K satisfy the algebraic matrix Riccati equations 


(3.13a) 


(3.13b) 

(3.13c) 

(3.13d) 


Rq" 1 

KA + ATK - KB B T K s- Q = 0 

Pc 


(3.13e) 


- - V 0 _1 A 

PA t + AP - PMT MP + DWDT = 0 

Pe 


The nominal closed-loop system is given by 


( 3 . 13f ) 


X 


A 

BG 

I 

i 

X 

1 

0 

0 


w 

• 






+ 





_ X _ 


_GM 

Ac_ 


X 


_0 

G^ 


_v_ 


y 

1 c 
= | 

0 


X 

_u_ 

1 

|_0 

G_ 


X 


(3.14a) 


(3.14b) 
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= 


(3.15) 


where A c = A + BG - GM and the closed loop system matrix 
“ A BG“ 

A A 

_GM Ac_ 
is asymptotically stable. 

Letting &A, aB, aC, aM and AO to be the maximum modulus derivations in the 
system matrices A, B, C, K and D respecti vely, we can write the total error matri: 
of the closed loop system as 
aA ABGm 


GmAM aAc 


(3.16) 


and writing aA - e a Ue a . aR = eb Ueb, AM = e m Ue m ... etc. and knowing the ratios 
s a / eb etc., crie can get the stability robustness condition in the same manner as the 
equations given by (3.5). 

Application t o- the Drone L ateral Altitude- Control Problem : 

The linearized model of the lateral attitude control problem of a drone 
aircraft, with perturbations in the plant parameters is given by 

x - (A + aA)x + Bu x ( 0) = x 0 (3.17) 

The components of the state vector x+R^ and the control vector u+R^ are given by 
xT = [8, 4>, tJj, 51/20, 62/20] 

uT = [ U1 U2l , ui = elevon command = 5i (3.18) 

u? = rudder command = 62 

The matrices A and B are given by (2.18). 

We assume that the parameters with non zero nominal values in the A matrix are 

subject to perturbations and thus we take the Ue a matrix as Ue a jj = j A-f j | / 1 A-f j | max . 

Accordingly the matrix Ue a is given by 
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0.0007 

0.0000 

0.0078 

0.0003 

0.0000 

0.0014 

0.3644 

0.0214 

0.0030 

0.0000 

0.9666 

1.0000 

0.0033 

0.0005 

0.0005 

0.0000 

0.0684 

0.1591 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.1555 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.1555 


The linear state feedback control gain is determined using the Riccati based 
equations of (3.10). For a given control gain (i.e. given p c ), the bound y is 
calculated. Since e a is not known, in this case the stability-robustness index 
85 . r. is simply given by Ss.r. = y. The plot of u with the design variable 
p c is given in Fig. 1. 

From the plot, it is seen that, for this problem, higher the control effort 


(lesser the p c ), higher is the tolerable perturbation for robust stability. 
We now extend the algorithm to the stochastic controller case using 
D = B, C = Ig, 0 = C T C = 16. R o = l 2 


W = I 2 


V 0 = 12 , M = 


1 0 0 0 0 0 
0 0 0 1 0 0 


(3.20) 


The plot of u vs p c with p e as a parameter and the comparison with the pure 
state feedback case is given in Fig. 2. 

Remark 4 : From this plot, it is seen that the bound u with state estimate 

feedback is lower than the one with pure state feedback. 

Remark- 5 : For a given p c , the bound y is higher as the measurement noise covariance 

is decreased, i.e. as p e is decreased. This appears to be reasonable, because 
this means that u becomes higher with better or more accurate measurements. 





Figure 2. Variation of Bound u with Control Weighting p c with State 
Estimate Feedback for Drone Example. 
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3 • 2 Li near State- Feedback Control for- 'Modal Systems' 

In this section we apply the robust control design methodology presented in the 
previous section to 'modal systems'. The evaluation model considered in the 
Large Space Structure (LSS) control problem constitutes a typical 'modal 
system' model. We specifically consider the LSS model with vibration suppression 
of the flexible modes as the control objective. We seek a linear state feedback 
control that achieves a reasonable trade off between the nominal performance and 
stability robustness by accommodating the modal uncertainty structure into the 
design procedure. Towards this direction, the fact that the modal data uncertainty 
increases with mode number is incorporated in the characterization of uncertainty in 
LSS model parameters and this uncertainty structure is used to obtain upper bounds 
for robust stability which are in turn used to get a robust controller. 

LSS Mo dels and Nominal - Control Besign 

Consider the standard state space description of LSS evaluation model with N 
elastic modes: 


x = Ax + Bu x(0) = x 0 ; x->-R n= 2N . u+R m 

y = Cx y-*-Rk 

where 


x T = [x! T , x 2 t , ... X|m t ] ; Xi 


ni 

ni. 


(3.21a) 

(3.21b) 


(3.21c) 


A = Block diag. [...Aii...], Aii = 



1 

-2c<o| 


(3.2ld) 


BT = [Bf, B 2 T, ... B N T]; Bi = 



( 3 .2 le ) 


C = [Ci C 2 ... C N ] 


(3.21f ) 
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The performance index for vibration suppression problem may be written as 


co N 

J = f [( Y 0^2 ^2 + n^) + p u^u]dt 
o ■(=! 

which can be written in the form 


(3.22) 


J = f (,yT Oy + p u T u)dt = f (x T CT OCx + p u^u)dt = J v + p J u (3.23) 
oo J 


where the matrix C of (3.21) is given by 
C = Block diag. [... C-j ...] 
and 

Ci = 


(3.24a) 

(3.24b) 


w-j 0 
0 1 _ 

Let the nominal control law be designed by minimizing the performance index of 
(3.23) which results in [13] 

u = Gx (3.25a) 

where 


G = - - BTK 

P 

kbb t 

KA + ATk K + C t QC = 0 


(3.25b) 

(3.25c) 


The closed loop system matrix 

A = (A + BG) (3.26) 

is assymptotically stable. In the nominal design situation, an appropriate 
value for p (and hence G) is determined such that a reasonable trade off 
between Jy and J u is obtained. However, in LSS models, the parameters of the 
plant matrix A, namely the modal frequencies and modal damping as well as the 
parameters of the control distribution matrix B, namely the mode shape slopes 
at actuator locations are known to be uncertain. It is also known that the 
uncertainty in these parameters tends to increase with increase in mode number. 
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Thus with variations aA and aB in the matrices A and B of (3.21), the- nominal 
control G of (3.25) cannot guarantee stability of the closed loop system. Thus 
one needs to design a control gain G that guarantees stability for a given 
range of perturbations aA and aB. This is done using the design procedure given in 
the previous section. In ocher words, the control design algorithm for robust 
stability consists of picking a control gain (i.e. p) that achieves a positive 
8 S.R. (for case a ) or high value of 8 s.r. (for case b). 

The design algorithm involves determining the index 8s. r. and the 
costs Jy and J u for different values of the design parameter p and plotting 
these curves. The algorithm thus provides a simple constant gain state 
feedback control law (using the standard optimal LQ regulator format) that is 
robust from stability point of view. The algorithm, for given perturbations, 
can be used for selecting the range of control weighting (control effort) for 
which the system is stability robust or alternatively for given control 
effort, can be used to determine the range of allowable perturbations for 
stabi lity. 

In the next section, we present a specific characterization of 

uncertainty for LSS models and use the above methodology to design a 

controller for the Purdue model [14] of a two dimensional LSS. 

Characterization- of Parameter Uncertainty in- L.S-.S. Models and Application to 
Purdue Model 

In L.S.S. models having the structure given by (3.21) the uncertainty in 
the modal parameters such as modal frequency dampings and mode shape slopes at 
actuator locations tend to increase with increase in mode number. One way of 
modeling this information in the uncertainty structure is given in the 
following (specifically we employ the relative variation format of (3.6)) 
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aA = 


0 0 
®i 5>j 


0 0 
2 ®2 ®2 

0 0 
3 @3 3 ® 3 


(3.27a) 


aB 


5b 


0 

biT 


0 

2 b 2 T 

0 

3b 3 T 


(3.27b) 


where Qi indicate the nominal entries corresponding to the ith mode. We 
assume 6 a = 05 which are not known. 

With the above proposed uncertainty structure, we apply the robust 
control design methodology of previous section to the Purdue model [14], The 
model used consists of the first five elastic modes. The numerical values of the 
model are given in ref. [14]. To conserve space the model is not reproduced here. 

Since * a (and Sjj) are not known, the present design corresponds to case b 
in which case we pick a control gain that gives high 8 s. r. = up. The plot of 
u r vs. p is given in Fig. 3. The robust control gain is the gain 
corresponding to p = 0 . 12 . 

Figs. 4 and 5 present the variation of up with control effort (i.e. p) 
assuming aA = 0 and aB = 0 respectively. From these plots it can be 
concluded that the control effort range available for guaranteed stability 
for mode shape (aB * 0, aA = 0) variation is limited in comparison to the 
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range available for model frequency variation. Thus mode shape (slopes at 
actuator location) variations are more critical from control point of view 
than modal frequency variations. 

3.3 Linear State Feedback -Control -Design -for 'Matched -Systems 

In the design procedures presented so far in this report, a linear state 
feedback control is determined by a chosen method (for example, a Riccati based 
control gain) and then its robustness property is investigated by computing the 
tolerable perturbations of the closed loop system formed by this control gain. This 
control gain is seen to qualify as a 'robust' control gain only if it makes the 
stability robustness index positive for a given perturbation range e (i.e. if 

u < c) . There is no guarantee that there exists a linear state feedback control gain 
that accommodates a given perturbation range. However it is shown by Thorp and 
Barmish in [15] that there exists a linear state feedback control that guarantees 
stability of the perturbed system provided the uncertainty satisfies the so called 
'Matching Condition (MC)'. Matching conditions in essence constrain the manner in 
which the uncertainty is permitted to enter the system dynamics. We denote the 
systems whose uncertainty structure satisfies Matching Condition as 'Matched 
Systems'. Assuming uncertainty only in the A matrix of the standard linear state 
space model given by (3.1), the uncertainty aA is said to satisfy the matching 
condition if there exists a matrix D such that 
aA = BD 

i.e. the uncertainty in A is in the range space of the control distribution matrix 

B. 

In this section, we combine the matching condition assumption with the 
elemental bound technique presented in the previous sections to design a linear 
state feedback controller that guarantees stability for the given range of 
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perturbations. The proposed method possesses theoretical justification only for 
simple second order systems with single input (at this state of research) but the 
method is seen to give encouraging results even for higher order systems. The 
proposed procedure is shown to compare favorably with other existing methods. 
Elemental Bounds- and- Linear-Control Design- Algorithm : 

Consider the simple asymptotically stable second order system given by 


x 


0 

_" a 21 


1 

-a22_ 


x 


321. 322 > 0 


(3.28) 


= A c x 


with perturbations in the elements a 2 i and a22» Let a = Max (a21» a 22)* 
The stability robustness bound y-for this system yields 


°max(PpiLe)s 
where one choice of U t is 


(3.29) 


Up = 


(3.30) 


0 0 

!_ a 2l/a a22 /a _\ 

and P satisfies the Lyapunov equation PA C + A C T P + 2I n = 0. Another choice for U e 
is 



(3.31) 


From the solution of the above Lyapunov equation, one can make the following design 
observation. 

Design Observation- 3 : The elemental perturbation bound y of (3.29) increases with 

increase in the magnitude of the nominal values of the elements a 2 i and a22* 


We now utilize the above observation in the context of designing a linear 
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controller for the simple second order system 


0 1 


"0 


x + 


_ -a 2 i -a 2 2 _| 


_ 1 _ 


(3.32a) 


= A c x + Bu (3.32b) 

with again a 2 i and 322 being the uncertain parameters, known to vary within a given 
interval. We can write the perturbation matrix aA c as 

aA c = e U e (3.33) 


where U p = 


e = Max(e2i ,e22) » e 21 and e 22 are tn e maximum 


L £ 2l/e £22 /e _l 

modulus deviations in a2i and a22 respectively. It is important to realize that for 
the above system's uncertainty structure, the matching condition [15] is satisfied. 


i .e. 


u e a BO (3.34) 

Hence, according to ref. [15], a linear controller that guarantees stability 
exi sts. 

With the aid of matching condition (3.34) and design observation 3, we can now 
present a linear control design algorithm for the system of (3.32), assuming £21* e 22 
(and thus e) are known and that the open loop perturbed system (A c + aA c ) is 
unstable. 

Linear Control - Design- Algorithm 

Step- 1 : Determine = l/a max (Plm u e)s (3.35) 

where P].A C ^ + A C ^T p^ + 2I n = 0 and A c ^ = A c . 

Step 2 : Let A c ^ = A c ^-WiU e . Note that I a21 1 2 > I a 22 1 2 - Determine y 2 = 


l/ CT max( p 2m u e)s where P2Ac2 + A c2 T p 2 + 212 = 0* Note that u 2 > U 1 by virtue of 
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design observation 3. Check if e < U2* If yes proceed to step 4. If not go 
to step 3. 

Step 3 : Repeat determining 

ui +1 = l/qnax( p (i+l)m u e)s (3.36) 

where P-j+iA c + A C T P-j+i + 21? = 0 
11 c i+l c i +1 1 1 L 


Ac^ + ^ = A^ - u-jUe (3.37) 

and checking if e < u-j+i i = 3,4,... 

Since y-j+i > u-j for each iteration, for some i+1 = a, we will have 

e < P a (3.38) 

The propagation of y with each iteration is depicted in Figure 6 . 

Step- 4 : Once e < y a , write 

a-1 

A Ca = A q - V y-jU 0 = A c — U(;Ug (3.39a) 

i =1 


where 

a-1 

y c = T ui • 
i=l 


(3.39b) 


Also from steps 2 and 3, all 



(i“l,2 


,a) as well as A Cct _+ ell e are stable. Let 


Ac a = Ac - y c ll e = A c - y c BD = Aq + BG (3.40) 

where u = Gx is the linear control law we are after. Thus from (3.40), the control 
gain which guarantees stability of the perturbed closed loop system in the presence 
of variations of magnitude e 21 an ^ e 22 1n the elements a 2 i and &22 1S given by 
G = -y c D (3.41) 

Application- Example 

We now consider the same example used in [15] and [16] for comparison purposes. 


The system is given by x = A(q)x + Bu where 
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0 1 | 

' 


A ( q ) = 



j 0 


_-2+qi l+q^J 

, B = | 

|_1_ 


= A 0 + E(q), 


Aq 


o i -i l qi 1 1 

-2 1 _ * -1 < q 2 < 1.5 


(3.42) 


In order to take advantage of symmetrical perturbation range assumed in our 
analysis, we take our 'nominal' system matrix and the perturbation matrix as 
follows: 


Nominal : x = A a x + 3u where A a 


0 

-2 


Perturbation : aA = eU e with qj = 1, e 22 


1 

1.2 5_ 

= 1.25 so that 


(3.43) 


Ue 


0 0 

0.8 1 


and e = 1.25. 


(3.44) 


Since the open loop 'nominal' system is unstable, we first stabilize the 
'nominal' system with a control law u = G^x where Gi = [1.04 -1.45] so that the 

stable nominal open looo system is given by 


Ac 


0 

1 


0 



, B = 


_-0.959 

-0.2 _ 


_ 1 _ 


(3.45) 


Now apl lying the design algorithm for the system (3.43), it is observed that 
after seven iterations y a = 1.2537 > e = 1.25. We obtain 


6 

u c = Y = 2.3995, also 0 = [0.8 1] 

i =1 


(3.46) 
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Hence the control gain defined by G of (3.41) is given by G = [-1.9196 -2.3995]. 
So the final gain for this example system is given by 

G f = Gi + G = [-0.8986 -3.8495] (3.47) 

It is to be noted that the final control gain Gf above is with respect to the 
open loop system matrix A a (and not A 0 ). Since the methods compared in [15]-[16] 
give the final control gain with respect to the matrix A 0 , we obtain the control 
gain obtained by the proposed method with respect to A 0 as 
G c = [-0.8786 -3.5995] 

= [-0.88 -3.6] 


(3.48) 


Thus G c is the gain to be used for comparison with other methods. 
Comparison : We reproduce the table given in [15] and [16]. 


Method 

|G C j 
11 

|G C | 
. ...12- 

l|G|! > [ E (-)2ij]^ 2 

GCC (Chang and Peng) 

1.36 

6.42 

6.56 

NGCC (Vinkler and Wood) 

0.33 

3.52 

3.53 

MC (Thorp and Barmish) 

0.67 

3.67 

3.73 

Elemental Perturbation Bound 
Analysis, EPBA (Yedavalli) 

0.88 

3.60 

3.70 

.... - - 

.. . . -- 



- - - - ...... 


Thus the proposed method fares well in comparison with the other methods. We 


believe that the proposed method is computationally simpler. 





Figure 3. Robust Control Gain Determination for LSS Model. 




nc«3 
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Figure 4. Variation of Bound with Control Effort for LSS Model (aA = 0, aB £ 0). 




1 ( AA * 0, AB = 0 ), 



- 39 - 



Figure 6. Propagation of with Each Iteration for Second Order Matched Systems. 
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IV. REDUCED ORDER DYNAMIC COMPENSATOR DESIGN FOR ROBUST STABILITY 
In the previous section, efforts were directed to design a linear full state 
(and state estimate) feedback controller for robust stability. However, in that 
treatment, the control gain determination does not directly involve the stability 
robustness criterion as a design constraint. Instead, for a predetermined linear 
control gain (obtained by many different nominal methods), the perturbation bound is 
calculated and in the cases where the parameter perturbation ranges are given, the 
stability robustness condition is checked (for robust stability). It is also seen 
that it is possible to guarantee stability for given perturbation ranges only for 
matched systems. No such guarantee exists for non-matched systems. 

In this section, we attempt to solve the control design problem for linear 
regulators in a more direct and general way by formulating it as a parameter 
optimization problem. Instead of designing the control gains by nominal means and 
then checking its stability robustness bounds, we propose to include the stability 
robustness condition explicitly in the design procedure as a design constant. In 
addition, we specify the structure of the controller in the form of a linear reduced 
order dynamic compensator (or given reduced dimension) which operates on the 
available measurements. In this way the control law is more practically 
implementable in contrast with the full order linear state feedback which demands 
the availability of the full state. Of course the problem formulation is such that 
the full order linear state feedback case comes out as a special case. The proposed 
formulation is presently given for deterministic systems with the understanding that 
the treatment for stochastic systems conceptually follows the same lines (with of 
course considerably different details). 

4.1 System Descript-ion-and- Peformance- Index- for Specification 
Consider again the linear time invariant system 




x (t ) = A x(t) + B u(t) 

y(t) = c x ( t ) 

z(t) - M x (t ) 
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(4.1) 


x(0) = x 0 


where the state vector x -»■ R n , the control vector u ->■ R m , output vector (the 
variables we wish to control) y -»• R k and the measurement vector z -»• R^. 

Let the m control vriables in the vector u evolve from an sth order linear 
dynamical compensator of prescribed structure operating on the z available 
measurements z, 


u = 9ii 3 + 3i2 2 


,3 * RS 


(4.2) 


3 = 321 3 + 922 2 6(0) = 0 

The 9-jj are constant gain matrices of appropriate dimensions to be determined 
according to a criterion discussed later. 

The closed loop system is then given by 


where 


x c = A c x c 


x c - R n+S , x c (0) = 


*o 
0 • 


y c = C c x c y c + R k+m 

x c T = CxT 3 t ] , y c T = [y T uT] 


(4.3a) 


(4.3b) 


Ac 


A + B 912 M 
. 9 22 m 


BQii 
9 21 _ 


Cc 


C 0 

_ 9l 2 M 9n 


(4.3c) 


(4.3d) 


We assume that the design is such that nominal closed loop system matrix A c is 


asymptotically stable. The matrices A c and C c can also be expressed as 



-42- 



>' 

0 

1 


B 0 

1 

0 Is 

= 


+ 


9 



_0 0 J 


_0 I s _ 


_M 0 _ 


(4.4a) 


■ A + B e M 


= 


"C 0 

0 0 


"o <n 


Ic 


I 9 M = C + I 0 M 


(4.4b) 


(4.4c) 


where 

& “011 01 i 

e = 

_ 9 21 922_l 

In the nominal linear regulator problem, the gain 9 is determined such that the 
following quadratic performance index is minimized. 


Min i „ . . 

W.T.t. Vi = - f (ylQy + u^R'u + 8 *R 28 )dt 
9 2 o 


- ( (yc%c + B^P20)^t where 0 
2 o 


0 0 ' 
_0 R l_ 


(4.5a) 


(4.5b) 


The weighting terms on s and u together penalize the full set of gains 9-jj 
quadratical ly. The omission of 8 term would preclude the gains 921 and 9 22 from 
getting weighted in the performance index. Here 0, Ri and R 2 are symmetric positive 
definite matrices of appropriate dimensions. 

The performance index V] obtained by ignoring the cross coupling terms in 
can be written as 


Vi = f x c T Q x c dt 
0 


(4.6a) 


where 
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0 = Block Diag [{C^QC + mT 022^R2022^ + M^9l2^"^l®12^^» 
{92i T R2621 + 011 T Rl01l}] 

A ^ A A A A A A 

= 0 + - [MWRflM + TM T eTReM T ] 

2 



I 0 

A 

Rl 0 

| C t QC 0 

T = 


, R = 

,0=1 


_0 -I_ 


p 2„ 

| _ 0 0_ 


(4.6b) 


(4.6c) 


Assuming the closed loop system matrix Ac to be asymptotically stable, the 
nominal performance index V} can be expressed as 


V 1 = f *c T 0 x c dt - Trace {P2 X.o) 
0 


where the matrix P2 satisfies the Lyapunov equation 
p 2 a c + A c t P2 + Q = 0 
and the matrix 


lo 


x 0 Xo T 0 I 

! 

0 oj 


(4.7a) 


(4.7b) 


(4.7c) 


As discussed in [17], the dependence of the controller on the initial condition 
Xg can be removed by assuming the initial condition x 0 to be a random variable with 
zero mean and uniformly distributed over a sphere of unit radius thereby expressing 


E(x 0 ) - 0 

E[XgXg T ] = Xg 

and then modifying the nominal performance index as 

__ 1 i m 1 t T •_ * ^ 

^1 = - E f (y c T IT y c + 8 T R2B)dt = Trace {P2 Xg} 

t-v® t 0 


(4.8) 


(4.9a) 
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where 


*o 



0 

0 


and P 2 is as given by equation (4.7b). 


(4.9b) 


Thus the nomi naf linear regulator problem with specified compensator structure is as 
fol lows: 

Find 9 such that 

Mi n _ 

{Trace P 2 X 0 > (4.10a) 

9 

subject to the constraint 

P 2 A C + A C T P 2 + Q = 0 (4.10b) 

A# 

where A c and 0 are given by (4.4), (4.6). Note that in A c and Q all matrices except 
9 are known. 

The above problem formulation is the standard optimal dynamic compensator 
design formulation discussed in many references [1 7] -[193 . Our intent now is to 
include the stability robustness condition also into the problem formulation when 
the above system matrices are perturbed by finite parameter variations. Let aA, 
aB, aC and aM be the maximum modulus deviations expected in the entries of A, B, C 
and M respectively. Then, as before, the perturbed closed loop system is given by 
• _ 

x cp = (Ac + AAc)xcp = Ac Xcp (4.11a) 

yep = C C p x cp 

where 

— A A A A A A A A A 

Ac = A + B9M + aA + AB9AM + AB9M + B9AM (4.11b) 


Since we are interested only in the stability robustness problem in this 
research (the performance robustness problem is a separate research topic of its 
own), our aim is to determine 9 such that, in addition to nominal regulation problem 
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as posed in (4.10), it also maximizes the stability robustness bound y which 
arises from the following stability robustness condition. Recall that the perturbed 
closed loop system matrix A c is stable if 

A A A A A A A 1 

[aA c = (aA + aB^aM + aB^M + Bfi m AM}]-jj max < (4.12a) 

tfmax( p lm u e)s 

where Pi satisfies 

PlA c + AjPi + 2l n+s = 0 (4.12b) 

and U e accommodates the structure of the perturbation matrices of the l.h.s. of 
(4.12a). Of course we can write 


aA - e a tJ e a» AB = eb^eb> AM = sm^em* AC = e^ec 
and knowing the ratios of e a , et> and e m , we obtain 



= e a U (4.13) 

where U is the matrix within the square brackets. Then one can obtain the stability 
robustness condition as 

1 A , 

e a < -r- = u (4.14) 

°tnax( p lmU)s 


Henceforth, we will assume that only aA is present for simplicity purposes. 
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From (4.14), it can be seen that u is a function of the control gains 9 through 
Pi and U. Also it may be noted that the problem of maximization of y with respect 
to 9 can be converted to that of minimixing ffmax^lmlOs with respect to 9 subject to 
the contraint (4.12b). 

Thus, we now pose a modified optimization problem by combining the stability 
robustness condition of (4.14) with the nominal regulation problem of (4.10) as 
follows: 

Find 9 such that the performance index 


v 2 = [°max( p lmU)s + Trace P 2 

(4.15a) 

is minimized subject to the constraints 


Pi A c + A C T + 2 I n+ s = 0 

(4.15b) 

p 2 A c + A C T P 2 + Q = 0 

(4.15c) 

and 


Re (X-j (Ac) } < 0. 

(4. 15d ) 

Modi fied Performance-Index: 



Note that the above performance index Vg contains a term involving the maximum 
singular value as well as a positive matrix Pi m . Optimization of an index like the 
one posed is a formidable task as it is almost computationally and analytically 
intractable. Hence we intend to modify the performance index such that it becomes 
more tractable. 

Noting that the Frobenius norm of a matrix is always an upper bound on the 
spectral norm of the matrix, i.e. 

I |(‘) I If 1 %ax(*) (4.16) 


and that 


CT max( ’ ) 2. a max( * )s 


(4.17) 
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we propose the following upper bound to be minimized instead of a max (Pi m U) s . 
Proposition 1 : 

V r - l - Trace [P 1 TWP 1 + PiWPi T ] > (4.18) 

for some suitable diagonal weighting matrix W. 

The diagonal weighting matrix W is such that Wj ■( = 0 whenever U-j j (j = 1,2,..., 
n+s) = 0 for a given row i and W-j -j = w-j whenever U-j j (j = l,2,...,n+s) * 0 for a 
given row i and any column j. Even though the specification of wj is crucial in 
establishing the upper bound property of V r as in (4.18), it turns out, as seen later 
in conjunction with the nominal regulation problem, that it is possible to specify 
the w-j -j > 0 as arbitrary and transfer its implication in the design to another design 
variable, namely pc , the weighting on the control variable. 

We are ricw in a position to state the problem of finding the 'optimal' dynamic 
compensator gains p for robust stability and nominal regulation of a linear 
regul ator. 

4 . 2 Compensator Des i gri by Parameter Optimization Technique 


Find a such that 

V 3 = { - Trace[P]JwPi + p^wPi"*"] + Trace P 2 Xq} (4.iya) 

8 2 

subject to the constraints 

PlA c * AjPj. + 2 1 n+ s = U (4.19b) 

?2^c + A c Tp 2 + Q = U (4.19c) 

8 e Xj LA C ] < U (4.19d) 


where A c and Q are as in (4.4 and 4.b) and W is given according to the structure of 


the U matrix. 
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Solution by Parameter Optimization : 

We approach the solution to the above nonlinear (quadratic performance index) 
proyramming problem by writing down necessary conditions and investigating the 
solutions which satisfy them. Using the technique of Layrange multipliers, we 
transform the above constrained optimization problem to an unconstrained 
optimization problem by defining the Hamiltonian. Thus we write 
Min 

{ H > (4.20) 

9 

where H is the Hamiltonian given by 

H = Trace - (P]JwP^ + PiWP]J) + P^Xq + t-i(PiA c + A c "^p^ + 21) 

(4.21) 

(4.22a) 
(4.22b) 
(4.22c) 
(4.22d ) 
(4.22e) 


+ L 2 (P 2 Ac + A c T P2 + Q)} 

and and L z are the Lagrange Multiplier matrices. 
Tne first order necessary conditions are: 


- = p lAc + A c T Pi + 21 = U 
3Ll 


aH T ~ 

= P2A c + A c t P 2 + g = u 
ai-2 


= Ll T A c T + h c L\ J + PiW + WPi = U 

3 Pl “ 


= L2 Ta c T + rt c>-2 T + Ao T = u 
aP2 


A A A A A A A 

— = 2B t (PiLi + P2L 2 )M t + Kq(ML2MT + MTL 2TMT) = 0 
36 
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In arriving at these conditions, the matrix derivative identities yiven in L20J are 
used. 

We can get the gain g computed by simultaneously solving for Pi, P 2 , Li and L% 
using equations (4.22). 

Special Cases : 

a) Standard nominal regulation problem with full state feedback: 

For this case W = U, en = 521 = 922 = 0, M = I, Li = U and we end up with the 
standard Algebraic Riccati equation. 

b) 'Optimal 1 state feedback for robust stability: 

For this case, M=I, gn = 921 = 922 = u * Tde yain 912 then is yi ven b y 
91? = -R _ ^B^lPiLi + P' 2 Lv)L 2 “^ (4.23a) 

c) ‘Optimal 1 measurement feedback tor robust stability: 

For this case gn = 921 = 022 ~ u ancl tt1e y 3 ™ 912 yiven by 

912 * -R -1 B t (PiLi + P2L2)M t (ML 2M t )- 1 (4.23b) 

4.3 Example and Discussion of the Results 

Consider the simple second order linear time invariant system given by 


• 

0 

1 

I 1 1 1 

X = 

_a 

-0.b_ 

x + | |u , X(U) = j 

IJU l_l_ 


where a is the uncertain parameter with nominal value a = 1 
y = x 

z = 12 ljx 

Let us consider a first order dynamic compensator haviny the structure 
u = 9118 + 912 Z 8 e R 1 

(4.2b) 

8 = 9218 + 922 z 9(b) = 0 



Si nee U ea 


0 0 
1 u 


, we select Wn = W 33 = U and W 22 = 1 and specify tne performance 


index as 


V 3 = Trace L{ - (Pi^WP^ + P^WPi^")} + P^o J 


(4.26) 


with I) = I 2 , Ki = I, K 2 = 1 and P^ and P 2 satisfying tne Lyapunov equations yiven Dy 
(4.22) with Ac being a 3x3 matrix. 

With the above weighting matrices and the performance index, the parameter 
optimization procedure presented before yields the 'optima ! 1 compensator gains to be 


9 


-6.6778 -1.2255 

-4.84iy 0.3275 


and the nominal closed loop system matrix A c is given by 


(4.27) 


A c 


U 1 U 

-1.45 -1.72 -6.67 

0.656 0.327 -4.84 


(4.28) 


The resulting bound U 21 on the uncertain parameter a for robust stability is given 


by 

U 21 = 1.1644 (4.29) 

In other words, with the dynamic compensator given by (4.27), tne uncertain 
parameter 'a' can tolerate perturbations up to + i.1644 from its nominal value a = i 
and still maintain stability. The dynamic compensator found in (4.27) is 'optimal' in 
the sense that it maximizes (albeit, in an approximate way) the perturbation bound 
the uncertain parameter can have, to maintain stability with the imposed restrictions 
on the control effort and nominal regulation as reflected by the weightings q, Ki and 
K' 2 * Note that the robustness weighting matrix W incorporates the uncertainty 
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structure (that only element is varyiny) in an explicit way. However, one limi- 
tation of the W matrix is that it does not t'ul ly reflect the uncertainty structure in 
the sense that we would use the same W (w^2 = 1 and w^ = W33 = U) even if both a£i 
and a ^2 were varyiny. Efforts are underway to prescribe a more versatile performance 
index (an upper bound on omax( p mUe)s ) that completely utilizes the structure of U e . 
Fortunately, when the uncertinty structure (i.e. U e matrix) is such that there is 
only one nonzero entry for each row, then the W matrix completely incorporates the 
uncertainty structure. Since w-j-j is arbitrarily specified, one needs to check, 
after the design is complete, whether the index Trace - + PxWPx^} is an upper 

bound on the quantity amax( p lm u e)s or not * If it is not, one can either change W 22 
or the control weighting Rx until this happens. 

Measurement feedback : 

Using the same weightings and procedure as before, the 'optimal' measurement 
feedback for the above example, i.e. 

u = 9X2 z (4.30) 

is given by 

u = 1.3878 z (4.31) 

which yields 

U 2 X = 1.278 (4.32) 

Comparison of 'Robust' State Feedback and 'Nominal' State Feedback 

With W = U (i.e. no requirement of robust stability) and the weightings Q = I 2 , 

= p R 0 = p (R 0 = 1 and p as a design variable), one can get the standard nominal 
optimal linear regulator state feedback control law given by the solution of the 
algebraic Riccati equation. 

with wxx = u = W 33 amd W 22 = 1 and the same control weightings as above, one can 
yet the 'optimal robust' state feedback control law determined by the proposed 
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parameter optimization (PU) method. 

The comparison of 'robust (PO) state feedback control law' vs. the 'nominal 

state feedback control law' is depicted in Fiy. 7 where the perturbation bound y21 

is plotted against the nominal control effort J un = (7 u T udt)l/2. 

o 

As anticipated, for a yi yen control effort, the robust control law yields a 
higher perturbation bound u^l than the nominal control law, indicating the usefulness 
of the proposed optimization procedure. 



8 . 20 


8. 40 


8. 45 


8. 50 


8.25 8.30 8.35 

control effort JU 

Figure 7. Variations of the Bound u with Control Effort. 
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V. CONCLUSIONS AND RECOMMENDATIONS FOR FUTURE RESEARCH 
s. 1 Work in Retrospect 

The main theme of the described research under the present grant has been to 
analyze and synthesize controllers tor robust stability for linear time invariant 
systems subject to linear time varying structured (elemental) perturbations. First 
the analysis of robustness was considered. Tne main contribution of the research in 
this aspect is the reduction of conservatism of the previously developed perturbation 
bounds for structured (elemental) uncertainty. This is done by employing a state 
transformation and the improvement of the proposed technique is illustrated with 
several examples. 

Then the aspect of control design is addressed. In this regard, first the case 
of linear state feedback control is considered. The linear state feedback control is 
determined by nominal means based on the Riccati equation and the bounds achieved by 
this control law are computed. The effect of state estimation in the control law 
(for stochastic systems) on the Dounds is illustrated by comparing it with the exact 
state feedback case. Then the special nature of 'modal systems' (as in Large Space 
Structure Control example) is incorporated in tne uncertainty structure and a linear 
state feedback control utilizing this special structure is developed. Finally in 
that section, the conditions under which a linear state feedback control exists (for 

i 

yiven perturbation range) is recalled (namely the matcning condition) and a desiyn 
algorithm is presented for determining the linear state feedback control for these 
'matcned systems' (for simple second order systems at this stage of research). 

Section IV comprises the major contribution of the research under this grant in 
which a desiyn procedure for determining reduced order dynamic compensators for 
robust stability is presented using the Parameter Optimization (PO) method. The 
maximization of the perturbation bound is posed as a minimization problem Dy 
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specifying an appropriate performance index and the control gains of a compensator of 
given structure are optimized to minimize the given performance index. The solution 
method leads to a set of necessary conditions which are then simultaneously solved to 
obtain the desired gains. The method is illustrated with the help of a simple 
example. 

The publications listed as Refs. L21-25J are the result of this study. 

As it normally occurs, another result of this study is that many interesting 
research topics surfaced for further investigation. These are summarized in the 
following. 

5.2 Avenues for Further Research Which Need the Continued Support of the 

NASA Langley Research Center 

1) The foremost area of research would be to further reduce the conservatism of the 
perturbation bounds by scaling. Note that a similarity transformation is not a 
necessary means (but only a sufficient means) to reduce the conservatism, line 
suggestion is to use positive real transformations. 

2) One extension that needs attention is to develop linear state feedback control 
law for higher order matched systems and then to consider the case of mismatched 
systems. 

3) An area of research would be to extend the development of explicit bounds for 
structured perturbation to time-invariant perturbations and examine the reduction 
in conservatism that can be achieved. 

4) Another area of interest is to compare the proposed 'Perturbation bound Analysis' 
approach to design with other relevant methods like the Guaranteed Cost Control 
of Chang and Peng L6J and the 'multimodel theory' of Ackermann. 

b) It is also of interest to probe the relationship between the perturbation bound 
and the corresponding degree of stability measured Dy the real part of the 
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dominant eigenvalue, i.e. the relationship Detween perturbation range and 
eigenvalue displacement. 

b) Another aspect for future research would be to extend the "Perturbation bound 
Analysis' for actuator-sensor location problems. 

7) An area of extreme interest would be to use the perturbation bounds as a 
criterion for selecting the critical parameters in a system and use this 
information in model/contol ler reduction and develop an algorithm for same ana 
compare it with other relevant schemes. 

b) Une foremost area of research would be to extend the proposed analysis and design 
methodology to the case of combined modeling errors such as parameter variation, 
mode truncation and possibly nonlinearities. 

y) There is need for probing into the comparison and contrast of frequency domain 
results and the proposed time domain results. 

10) Une immediate application of the developed perturbation Dound analysis is in the 
area of stability analysis and control design for large scale interconnected 
systems (decentralized control). 

11) It is instructive to extend the proposed concepts to the case of combined 
'stability robustness' and 'performance robustness' where 'performance' is 
measured in terms of speed of response, percentage overshoot, damping 
enhancement, etc. 

12) Some interesting application areas are: (i) the vibration control of mechanical 
systems, (ii) active flutter control in aircraft, (iii) failure mode 
analysis in turbofan engine control, and (iv) control of robot manipulators. 
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